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Abstract 

According to the Dudley-Wichura extension of the Skorohod represen¬ 
tation theorem, convergence in distribution to a limit in a separable 
set is equivalent to the existence of a coupling with elements converg¬ 
ing a.s. in the metric. A density analogue of this theorem says that a 
sequence of probability densities on a general measurable space has a 
probability density as a pointwise lower limit if and only if there exists 
a coupling with elements converging a.s. in the discrete metric. In this 
paper the discrete-metric theorem is extended to stochastic processes 
considered in a widening time window. The extension is then used to 
prove the separability version of the Skorohod representation theorem. 
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1 Introduction 

Let Xi, X2 ,..., X be random elements in a general space {E, £) with distri- 
bntions Pi, P2,..., P. Let /i, U,..., / be the densities of Pi, P2,..., P with 
respect to some measnre A on Note that snch a measnre A always 

exists, we conld for instance take A = P -|- X^^i 2 “”'P„. If 

liminf fn = f a.e. A ( 1 ) 

n—^00 

we write 

Xn —)■ X in density as n —)■ cxd. 
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Note that fn/f is defined almost everywhere P. It is the Radon-Nikodym 
derivative dPn/dP of the absolutely continuous part of with respect to P. 
Thus convergence in density does not depend on A and is equivalent to 

liminf dPn/dP = 1 a.e. P. 

n—>-oo 

In general, lim inf„_j.oo fn = f a-e. A is weaker than hm„_j,oo fn = f a.e. A and 
stronger than convergence in total variation. However, if {E,S) is discrete 
(that is, if E is countable and £ = 2^ = the class of all subsets of E) then 
these three modes of convergence are equivalent and simplify to 

lim = x) = P(X = a;), x G E; 

n^oo 

see Theorems 6.1 and 7.1 in Chapter 1 of HU. 

Let (Xi, X 2 , • • •, X) denote a coupling of Xi, X 2 ,..., X; this means that 
the random elements Xi,X 2 ,...,X are defined on a common probability 
space and have the marginal distributions Pi, P 2 ,..., P. In a 1995 paper ra. 
Section 5.4, this author showed that convergence in density is equivalent to 
the existence of a coupling converging in the discrete metric, that is, ([T]) holds 
if and only if there exists a coupling (Xi, X 2 ,..., X) of Xi, X 2 ,..., X such 
that for some random variable N taking values inN={l,2,...}, 

X„ = X, n^N. (2) 

This density result is analogous to the Skorohod representation theorem 
which says that convergence in distribution on a complete separable met¬ 
ric E with £ the Borel sets (a Polish space) is equivalent to the existence 
of a coupling converging a.s. in the metric. Skorohod proved this theorem 
in the 1956 paper [9], Dudley removed the completeness assumption in the 
1968 paper [6], and Wichura showed in the 1970 paper [12] that it is enough 
that the limit probability measure P is concentrated on a separable Borel set; 
for historical notes, see [?]• The density result in HDl was rediscovered by 
Sethuraman [8] in 2002. For recent developments going beyond separability 
and considering convergence in probability, see the series of papers m-ia by 
Berti, Pratelli and Rigo. 

In the present paper we extend the above mentioned density result at ([2|) 
to stochastic processes considered in a widening time window. The main 
result. Theorem 1, is established in Section 2 while Section 3 contains corol¬ 
laries elaborating on that result. In Section 4, we show how this yields a new 
proof of the separability version of the Skorohod representation theorem. 
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2 Convergence in a widening time window 

In this section we consider continuous-time stochastic processes without re¬ 
striction on state space or paths. Also we allow the state space to vary 
with time and include inhnity in the time set. Discrete-time processes are 
considered at the end of the section. 

Let t e [0, cxd], be a family of measurable spaces. Let iL be a 

non-empty subset of the product set {(z®)sg[o,oo] : G G [0, cx)]} and 

let "H be the smallest cr-algebra on H making the maps taking ( 2 :^)sg[ 0 ,oo] £ H 
to e measurable for all t G [0, cx)]. For t G [0, cx)), let be the 

image space of under the map taking (2 ;s)sg[0,oo] G iL to (2;s)se[o,t)- 

If Z = (Z«),e[o,oo] is a random element in write Z* = for 

a segment of Z in a hnite time window of length t G [0, cxd). Note that Z* is 
a random element in 

According to the following theorem, convergence in density in all hnite 
time windows is the distributional form of discrete-metric convergence in a 
widening time window. (Note that the coupling in this theorem is not a full 
coupling of Zi, Z 2 ,..., Z but only a coupling of Z^^, Z^^,..., Z. Extensions 
to a full coupling are considered in the next section.) 

Theorem 1. Let Zi, Z 2 ,..., Z be random elements in where 

is as above. Then 

Vf G [0, 00 ) : Z(j —)■ Z* in density as n ^ 00 (3) 

if and only if there exists a sequence of numbers 0 ^ ^ ^2 ^ • • • —t cxo and 

a coupling (Z)\ Z^^,..., Z) 0 / Z^\ Z^^,..., Z such that for some N-valued 
random variable N, 

Z(;* = Z*", n^N. (4) 

Proof. First, assume existence of the coupling. Fix t G [0, cx)), take m G N 
such that tm ^ and note that then (|1]) yields = Tf for n ^ max{V, m}. 
Use this and the fact that (|2]) implies convergence in density to obtain ()5|). 

Conversely assume that ([3|) holds. With t G [0, cxd) and n G N, let Q be the 
distribution of Z, let Q* be the distribution of Z*, let be the distribution of 
Z(j, let /* be the density of Z(j with respect to some measure A* on (iL*, yf), 
and let be the measure on with density := inf^j.^/^. Due 

to the assumption ([3]), increases to a density of Z* as n —)■ 00 . Thus by 
monotone convergence, the measure i/* increases setwise to Q^, 

I/* ^ z /2 ^ • Z' Q*, f G [0, 00 ). 
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Thus there are numbers 0 ^ ^ ^2 ^ oo such that 

0 ^ Q*" - z/*" ^ 2“”, n eN. 

For A G y, and z*'* G if*", let q^^{A \ z***) be the conditional probability of 
the event {Z G v4} given Z*" = z*". Then 

Q{A) = J q^-{A\-)dQ^'^, AeH. 

Since z/*" ^ Q*" the measure z/*” is absolutely continuous with respect to Q*". 
Thus we can extend z/^" from to a measure z/„ on [H^l-C) by 

Un{A) := J q^-{A\ •) A G "H. 

The last three displays yield 

0 ^ Q — z/„ ^ 2“", n G N. 

Let hn be a density of z/„ with respect to Q. For integers n < m let ^n,m be 
the measure with density min„scj^m hj with respect to Q. Partition H into 
sets An, ..., Am G y such that min„^j^m hj = hi on Ai and thus 

n Aj) = z/i(-n Aj), 

The last two displays yield 

m oo 

O^Q- qLn,m = 5^(Q(- n Ai) -Ui{-n Ai)) ^ ^ 2-' = 2-"+b 

i=n i=n 

Let Hn be the measure with density inf„sgj<oo hi with respect to Q and send 
m —>■ cx) to obtain 0 ^ Q — Hn ^ 2“"+^. Thus the Hn increase setwise to Q, 

0 =: po ^ Ail ^ Ai2 ^ Q- (5) 

Let Hn be the marginal of Hn on {H^,y^). Note that z^*" is the marginal 
of Un on and that Hn ^ A^n.m and Hn,m ^ ^n- Thus ^ z/*". 

Now z/* has density Qn = inf^^n fl and Qn has density /* and thus z/* ^ 
Since ^ z/*" this yields 

H^n^Qn. ( 6 ) 

Keep in mind ([5|) and ([6]) throughout the following coupling construction. 
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Let (n, P) be a probability space supporting the following collection 
of independent random elements with distributions to be specihed below: 

N, Vi, V 2 ,..., Wi, W 2 ,... 

Let N be M-valued with distribution function (see (E])) 

P{N ^n) = neM. 

Let V„ be a random element in with distribution (see (1^ ) 

(arbitrary distribution if P(A^ = n) = 0). 

P(A' = n) 

Let W„ be a random element in with distribution (see (]^) 

—Y -\ (arbitrary distribution if P(iV > n) = 0). 

P(iV > n) 

Put Z = Vjv to obtain that Z has the same distribution as Z, 

00 00 

P(Z e ■) = P(V. G ■)P{N = n) = - fin-l) = Q. 

n=l n=l 

Put on {N ^ n} and Z^^ = W„ on {N > n} to obtain that Z^^ 

has the same distribution as Z([*, 

n 

P{zl^ e-) = Y, P(yi" e ■)P{N = k) + P{Wn e ■)P(A^ > n) 

k=l 

n 

= + (Qn - k^n) = Qn- 

k=l 


By definition Z = V^v and thus Z*" = V^. Also by definition, Z^^ = on 
{A^ ^ n}. Thus Z(j" = Z*" when N, that is, (0]) holds. □ 

If Z = (Z\ ..., write Z^ = (Z\ ..., Z^) for a segment in a 
hnite time window of length fc G N U {0}. The following is a discrete-time 
version of Theorem 1. 

Corollary 1. Let Zi, Z 2 ,..., Z he random elements in some product space 
{E\8^) 0 (^2, T2) 0 • • • 0 (Z°°, 8°^). Then 

Vfc G N ; Z^ — 7 - Z^ in density as n ^ 00 
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if and only if there exists a sequence of integers 0 ^ /ci ^ A ;2 ^ cxd and 

a coupling Z^^,..., Z) of TJf^, Z^^,..., Z such that for some 'H-valued 
random variable N, 

Z^" = Z'^", n ^ iV. 

Proof. Apply Theorem 1 to (^f ^^^)se[o,oo], • • •, (^^^■^*')sg[o,oo]- 

(Or repeat the proof of Theorem 1 with t and tn replaced by k and kn-) □ 

3 Extensions to a full coupling 

The coupling in Theorem 1 is not a full coupling of Zi, Z 2 ,..., Z but only a 
coupling of Tff, Tff ,..., Z. However, in the discrete-time case of Corollary 1, 
if we restrict all but the inhnite-time state space to be discrete, then there 
is the following simple extension of the coupling. It will be used in Section 4 
to establish the separability version of the Skorohod representation theorem. 

Corollary 2. Let Zi,Z 2 ,...,Z he random elements in the product space 
0 0 • • • 0 {E°°, £°°) where {E^, £^), T^),... are discrete 

and {E°°,S°°) is some measurable space. Then 

V/c G N ; Z^ —)■ Z^ m density as n ^ 00 

if and only if there exists a coupling (Zi, Z 2 , • • •, Z) 0 / Zi, Z 2 ,..., Z such that, 
for some N-valued random variable N and integers 0 ^ /ci ^ /c 2 ^ • • • —t cxd, 

Z^" = n-^N. 

Proof. Due to Corollary 1, we only need to show that (Z^^, Z^^,..., Z) can 
be extended to a coupling of Zi, Z 2 ,..., Z. For that purpose set, for n G N 
and G X X • ■ ■ X E^^, 

Qn,ikn = the conditional distribution of Z„ given {Z^" = i^"}. (7) 

Let the probability space (D, E, P) supporting Zj^^, Z^^,..., Z, A^ be large 
enough to also support random elements in {E^, T^)0(i7^, T^)0- • -0(77°°, £°°), 

n G N, G X X ■ ■ • X E^-, 

that are independent, independent of {Z\^, Z ^^,... ,Z,N), and such that 
and has distribution Qn^i^n- 
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Define = V . Then 

Tl^Zjn 

P(Z„ e ■) = e ■)P(Z^ = i"") = 5^Qn,i^nP(z^ = 

i^n i^n 

Since Z^" has the same distribntion as Z^" we obtain from this and ([7]) that 
Z„ has the same distribntion as Z„, as desired. □ 

In Corollary 2 we obtained a fnll coupling of Zi, Z 2 ,..., Z in the discrete¬ 
time case by restricting and to a discrete state space for fc G N but 
without restricting the state space of Z^ and Z°°. We shall now much weaken 
this restriction at the expense of putting a restriction on Z^ and Z°°. 

Corollary 3. Let Zi, Z 2 ,..., Z be random elements in the product of Polish 
spaces {E^, S^)(Z{E'^, ■ ■(Z{E°°, S°^). Then the coupling (Z^^, Z^^,..., Z) 

in Corollary 1 can be extended to a coupling Zi, Z 2 ,..., Z of Zi, Z 2 ,, Z. 

Proof. Let (D, P) be the probability space supporting the random ele¬ 
ments Z’l^, Z 2 ^,..., Z, in Corollary 1. Since a countable product of Polish 
spaces is Polish, there exist probability kernels Qn{- | ^ such that 

Qn{A I z^") is the conditional probability of {Zn G A} given Z^" = 

A ^ (Z £‘^ ■■■ £°° and z^^ G E^ x E‘^ x ■ ■ ■ x E^". According to the 

lonescu-Tulcea extension theorem, this implies that the probability space 
P) can be extended to support Zi, Z 2 ,... such that Z^" coincides 
with Zn in the time window of length kn and the conditional probability of 
{Zn G A] given Z^" = is Qn{A \ A G £^ Z £‘^ Z ■ ■ ■ Z £°° and 
g E^ X E^ X ■■■ X E^'^. From this it follows that Z„ has the same 
distribution as Z„, as desired. □ 

The final corollary extends Corollary 3 to continuous time. 

Corollary 4. Let Zi, Z 2 ,..., Z be random elements in {D,E) Z {E,£) 
where {D^V) = (D[0, cxo), P[0, 00 )) is the Skorohod space of a Polish space 
and {E,£) is Polish. Then the coupling (Z^\ Z^^,..., Z) in Theorem 1 can 
he extended to a coupling (Zi, Z 2 ,..., Z) 0 / Zi, Z 2 ,..., Z. 

Proof. The Skorohod space (D, V) is Polish and thus the product (FT, PL) = 
{D, V) Z {E, £) is Polish. Proceed as in the proof of Corollary 3 referring to 
Theorem 1 rather than Corollary 1, replacing kn by tn, and with A & PL and 
z*" G iF*". □ 
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4 The Skorohod Representation 

In this section let be a metric space with metric d and 8 its Borel snbsets. 
Recall that is said to converge to X in distribntion as n —)■ cxo if for all 
bounded continuous functions h from E to R, 

J hdPn^ j hdP, n —)■ oo. 

Recall also that A & 8 is called a P-continuity set if P{dA) = 0 where dA 
denotes the boundary of A, and that by the Portmanteau Theorem (Theorem 
11 . 1.1 in 0 ) convergence in distribution is equivalent to 

Pn{A) —)■ P{A) as n ^ oo for all P-continuity sets A. ( 8 ) 

We shall now use Corollary 2 to prove the Skorohod representation theorem 
in the separable case. 

Theorem 2. Let Xi, X 2 ,..., X be random elements in a metric space E 
equipped with its Borel subsets 8. Further, let X take values almost surely in 
a separable subset Eq E 8 . Then 

Xn -E X in distribution as n ^ 00 (9) 

if and only if there is a coupling (W,X 2 , ... ,X) of Xi, X 2 ,..., X such that 
Xn X pointwise as n —)■ 00 . (10) 

Proof. Let d be the metric. We begin with basic preliminaries. First, 
assume existence of the coupling and let h be a bounded continuous function. 
Then (10) yields that h(X„) —)■ h{X) pointwise as n —)■ 00 and by bounded 
convergence, J hdPn —)■ J hdP as n ^ 00 . Thus ([9]) holds. 

Conversely, assume from now on that (jH]), and thus (jS]), holds. For each 
e > 0, any separable Borel set can be covered by countably many P-balls of 
diameter < e. Note that for every y E E and r > 0, d{x E E : d{y, x) < r} C 
d{x G E : d{y, x) = r} and that the set on the right-hand side has P-mass 0 
except for countably many radii r. Thus the covering sets below may be 
taken to be P-continuity sets. Moreover, since d{A H P) C dA U dB for all 
subsets A and B of E, the covering sets can be taken to be disjoint. 

Let A 2 , A 3 ,... be disjoint P-continuity sets of diameter < 1 covering Eq 
and put Ai = E \ {A 2 U ^3 U ...). Then Ai is also a P-continuity set since 
P{Ai) = 0 and since dAi cannot contain interior points of the P-continuity 
sets A 2 , A 3 ,... Thus {Ai : i G N} is a partition of E into P-continuity sets. 


Put All = Ai and A 12 = Ai^ = ■ ■ ■ = 0. For i > 1, let Ai 2 ,Ai 3 ,... be 
disjoint P-continuity subsets of Ai of diameter <1/2 covering Eq fl Ai and 
put Ail = Ai \ {Ai 2 U Ai'i U ...). Then again {^412 : e N^} is a partition 
of E into P-continuity sets. Continue this recursively in A; G N to obtain a 
sequence of partitions {A-^k : i^G of E into P-continuity sets such that 

Ap, i^G (N \ {1})*^, cover Eq and are each of diameter < 1 /k (11) 

and such that the partitions are nested in the sense that for A: G M and 

ifc ^ ij u ... 

After these basic preliminaries, we are now ready to apply Corollary 2. 
Let Zi, Z 2 ,..., Z be the random elements in (N, 2^)^ ® i.E,8) dehned as 
follows (well-dehned because the partitions are nested): set and 

= X and for A: G N 

Zl = i^ if Xn G Aifc and Z^ = if X G 

Due to ([8]), we have P(Z^ = i*^) —> P(Z^ = i^) as n —)■ c», G A: G N. 

Thus Z^ —Z^ in density as n —)■ c» and Corollary 2 yields the existence of a 
coupling (Zi, Z 2 ,..., Z) of (Zi, Z 2 ,..., Z), an N-valued random variable N, 
and integers 0 ^ A:i ^ A :2 ^ cxo, such that 

Z^" = Z^", N. (12) 

Now dehne the coupling of Xi, X 2 ,..., X by setting X„ = Z^ and X = Z°°. 
Then (after deleting a null event) we have that X G Pq and that for A; G N 

Z^ = i^ if X„ G Aik and Z^ = if X G Ai^. 

Thus Xn £ A^kn and X G A^kr, for all n G M. Apply (IT^ to obtain that 

both Xn G A^kr, and X G A^k^ when N. (13) 

Finally, apply flTTD : since X E Eq we have that Z^" G (M \ {1})^" so A^kr, 
has diameter < 1/A:„. From this and flT^ we obtain that 

d{Xn,X) < 1/kn, n^N. 

Since N < 00 and lim„^ool/A:n = 0 this implies that d{Xn,X) —)■ 0 point- 
wise, that is, (10) holds. □ 
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